Skip to content

fix(inference): keep routed models visible and surface retries - #154

Merged
ScriptedAlchemy merged 2 commits into
mainfrom
codex/fix-routed-models-and-replies
Nov 18, 2026
Merged

ScriptedAlchemy merged 2 commits into
mainfrom
codex/fix-routed-models-and-replies

Conversation

@ScriptedAlchemy

@ScriptedAlchemy ScriptedAlchemy commented Nov 18, 2026 •

Copy link
Copy Markdown
Owner

Routed Codex showed raw model IDs in the picker. A host cooldown could drop a supported model from the saved catalog and silently change the composer's selection. During the same failure, Codex could spend minutes in an internal HTTP retry before T3 showed a useful message.

Keep known cooling models in the catalog and show them as unavailable until a route can serve them again. Preserve saved selections and use readable labels for routed model IDs. Honor upstream cooldowns for single and multiple hosts and surface Codex stream retries with the reason and wait time.

Verification

  • The browser scenario fails on the base when 6.2 Astra disappears during a cooldown. It passes on this branch, showing the readable labels, retaining Astra's selection and restoring availability after the cooldown.
  • The installed Codex CLI reported a 320-second cooldown on the first retry notification through T3's inference handler. A separate one-second cooldown recovered on the same route and completed with an assistant reply.
  • vp run check:changed e5ade97dee passed, including 478 tests beside the changes. Web and desktop share the verified picker. Mobile passed the affected tests and typecheck.

The base is shown above the fix during the simulated cooldown.

clipboard

GPT-6.2 Sol via Codex.

@changeset-bot

changeset-bot Bot commented Nov 18, 2026 •

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: d6348a8

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@ScriptedAlchemy
ScriptedAlchemy merged commit 6e72387 into main Nov 18, 2026
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant